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(54) Image processing method and apparatus and recording medium 



(57) Disclosed is an image processing method. 

According to the present invention, an image 
processing method comprises the steps of retaining on 
file a profile for an input device and a profile for an output 
target film, employing the profiles for the input device 



and for the output target film to prepare a color repro- 
duction table to facilitate the input of image data that is 
near that of the output target film, and correcting the 
colors of the input image data in accordance with the 
table that is prepared. 
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Description 

BACKGROUND OF THE INVENTION 
5 Field of the Invention 

[0001] The present invention relates to an image processing method and apparatus, for correcting an image, and to 
a recording medium. 

10 Related Background Art 

[0002] Various algorithms have been proposed for use in correcting the highlighting, shadow, contrast and white 
balance for an image recorded by a digital camera. 

[0003] However, even when adjustments are made for highlighting, shadow, contrast and white balance, the image 
is quality provided by a digital camera that faithfully reproduces the color of an object is not as satisfactory as is the image 
quality provided by silver halide photography. 

[0004] This is true because with silver halide film desired colors are reproduced. That is, so-called memory colors 
in particular, such as the colors of skin, the sky, and glass, are not always faithfully reproduced, but rather, color tones 
are shifted and colors are reproduced in accordance with individual preferences. Such color tone shifting is performed 
20 for images recorded using silver halide film. 

SUMMARY OF THE INVENTION 

[0005] It is, therefore, a concern of the present invention to provide a method whereby, to reproduce preferred colors, 
25 corrections are made to an image recorded using a specific input device so that the tones and colors of the image 
more nearly correspond to those that would be produced using silver halide film. 

[0006] According to a first aspect of the present invention, an image processing method comprises the steps of: 

holding a profile for an input device and a profile for an output target film; 
30 preparing a table to approximate a color reproducibility of an output target film as to a color reproducibility of input 

image data on the basis of the profile for the input device and the profile for the output target film; and 
correcting the color of the input image data by using the prepared table. 

[0007] According to a second aspect of the present invention, an image processing method comprises the steps of: 

35 

correcting a color of input image data by using a table prepared on the basis of a color reproducibility for input 
image data and a color reproducibility for an output target; and 

emphasizing an edge of a highlighted portion of the image data obtained by color correction. 

40 [0008] Features and advantages other than those discussed above will become apparent to those skilled in the art 
during the course of the description of the preferred embodiments of the invention that follows. In the description, 
reference is made to accompanying drawings, which form a part thereof and which illustrate an example of the invention. 
Such a description, however, is not an exhaustive recital of the various possible embodiments of the invention, and 
reference is therefore made to the claims that follow the description for a determination of the scope of the invention. 

45 

BRIEF DESCRIPTION OF THE DRAWINGS 
[0009] 

50 Fig. 1 is a diagram illustrating the arrangement of an image correction apparatus according to a first embodiment 

of the present invention; 

Fig. 2 is a flowchart showing the processing according to the first embodiment of the present invention; 
Fig. 3 is a diagram showing data held in a input device profile holding unit; 
Fig. 4 is a diagram showing data held in an output target film profile holding unit; 
55 Fig. 5 is a flowchart showing the processing performed by a lookup table preparing unit; 

Fig. 6 is a diagram showing an example lookup table held in a lookup table holding unit; 

Fig. 7 is a flowchart showing the processing performed by an image correcting unit according to the first embodiment 

of the present invention; 
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Fig. 8 is a graph showing an example profile for an input device; 
Fig. 9 is a graph showing an example profile for an output film; 

Fig. 10 is a flowchart showing the processing performed by an output device selecting unit; 
Fig. 11 is a flowchart showing the processing performed by an edge emphasis processing unit; 
5 Fig. 12 is a diagram illustrating the arrangement of an image correcting apparatus according to a second embod- 

iment of the present invention; 

Fig. 13 is a flowchart showing the processing performed for the second embodiment of the present invention; 
Fig. 14 is a flowchart showing the processing performed by a histogram preparing unit; 
Fig. 15 is a graph showing an example histogram that has been prepared; 
10 Fig. 16 is a flowchart showing the processing performed by a lookup table preparing unit in Fig. 12; 

Figs. 17A and 17B are diagrams showing example lookup tables held in a lookup table holding unit in Fig. 12; 
Fig. 18 is a flowchart showing the processing performed by an image correcting unit according to the second 
embodiment of the present invention; 

Fig. 1 9 is a diagram illustrating the arrangement of an image correcting apparatus according to a third embodiment 
is of the present invention; 

Fig. 20 is a flowchart showing the processing performed for the third embodiment of the present invention; 

Fig. 21 is a diagram showing image data and an image header stored in an image buffer; 

Fig. 22 is a flowchart showing the processing performed by a lookup table preparing unit when an input device is 

other than a digital camera; and 
20 Fig. 23 is a flowchart showing the processing performed by an output device selecting unit. 



DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 



[001 0] The preferred embodiments of the present invention will now be described while referring to the accompanying 
25 drawings. 



(First Embodiment) 



[0011] Fig. 1 is a diagram showing the arrangement of the essential portion of an image correction apparatus ac- 

30 cording to a first embodiment of the present invention. 

[0012] The image correction apparatus in Fig. 1 comprises: an image inputting unit 2, an image outputting unit 3, an 
image buffer 4, an input device profile holding unit 5, an output target film profile holding unit 6, an input/output device 
selecting unit 7, a lookup table preparing unit 8, a lookup table holding unit 9, an image correcting unit 10, an edge 
emphasis processing unit 12, and an image buffer 13 for copy. 

35 [0013] The image inputting unit 2 reads data from an input image 1 , and writes the data in the image buffer 4. The 
image outputting unit 3 writes, as an output image, the data stored in the image buffer 4 wherein the image data are 
held. The input device profile holding unit 5 holds profiles for several types of input devices and for an input device 
that is currently being selected. The output target film profile holding unit 6 holds profiles for several types of films to 
be output and an output film that is currently being selected. The input/output device selecting unit 7 selects an input 

40 device and stores the selected input device type in the input device profile holding unit 5, and selects an output target 
film and stores the selected film type in the output target film profile holding unit 6. The lookup table preparing unit 8 
prepares a lookup table by employing the data stored in the input device profile holding unit 5 and in the output target 
film profile holding unit 6, and stores the lookup table in the lookup table holding unit 9. Based on the lookup table held 
in the lookup table holding unit 9, the image correcting unit 10 corrects image data stored in the image buffer 4. The 

45 edge emphasis processing unit 12 emphasizes the edge of a highlighted portion. The image buffer 13 used for copy 
is used for the temporarily storage of a copy of the image data held in the image buffer 4 when the edge emphasis 
processing is performed. 

[0014] The operation of the image correction apparatus can be implemented by supplying to a personal computer, 
for example, a program for performing, or for exercising control of the operations of the individual sections. In this case, 
50 the CPU of the personal computer performs, or exercises control of the individual section operations based on the 
contents of the supplied program. 

[001 5] The first embodiment of the present invention will now be described in detail by employing a specific example. 
[0016] Fig. 2 is a flowchart showing the processing for the first embodiment. 

[001 7] At step S1 1 , an input image is read from the image inputting unit 2, and the image data are stored in the image 
55 buffer 4. 

[0018] At step S12, the lookup table preparing unit 8 prepares a lookup table. The detailed operation of the lookup 
table preparing unit 8 will be described later while referring to Fig. 5. 

[0019] At S13, the image correcting unit 10 corrects an image. The detailed operation of the image correcting unit 
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10 will be described later while referring to Fig. 7. 

[0020] At step S14 the edge emphasis processing unit 12 performs an operation to emphasize the edge of a high- 
lighted portion. The detailed operation performed by the edge emphasis processing unit 1 2 will be described later while 
referring to Fig. 11. 

5 [0021] At step S1 5 the contents of the image buffer 4 are written to the output image buffer 1 1 by the image outputting 
unit 3. 

[0022] Fig. 3 is a diagram showing the data structure of an input device profile held in the input device profile holding 
unit 5. 

[0023] The input device profile has a two-dimensional data structure that consists of the patch numbers of individual 
10 gray scales, and the corresponding RGB values of input devices. When the number of input device types is increased, 
only the RGB values for individual patches of-corresponding gray scales need be measured and added to the table. 
[0024] The type of device that is currently being selected is also held in the input device profile holding unit 5. This 
device type can be changed by the input/output device selecting unit 7. In the initial state, any one of the devices can 
be selected 

is [0025] Fig. 4 is a diagram showing the data structure of an output target film profile that is held in the output target 
film profile holding unit 6. 

[0026] The output target film profile has a two-dimensional data structure that consists of the number of patches of 
gray scales and the corresponding RGB values of output target films. When the number of output target film types is 
increased, only the RGB values for the patches corresponding to the gray scales need be measured and added to the 
20 profile. 

[0027] The type of film that is currently being selected is also held in the film profile holding unit 6. The film type can 
be changed by the input/output device selecting unit 7. In the initial state, any one of the devices can be selected. 
[0028] The operation performed by the input/output device selecting unit 7 is shown in Fig. 10. 
[0029] At step S41 , the name of an input device is selected and is stored in the input device profile holding unit 5. 

25 When, for example, a profile conforming to the ICC standard is added to the input image data, the name of the input 
device is automatically selected based on the header information for the profile. When a profile is not added to the 
input image data, the name of the input device is selected based on an instruction issued by a user that is entered at 
a user interface that is unique to the image correction apparatus of the present invention and that is displayed on the 
monitor of a personal computer. 

30 [0030] At step S42, the name of an output film is selected and is stored in the output target film profile holding unit 
6. As the name of the output film, the name of an output device is selected based on an instruction issued by a user 
that is entered at a user interface that is unique to the image correction apparatus of the present invention. 
[0031] The name of an input device and the name of an output film can be selected at any time, except during the 
correction processing. 

35 [0032] The operation performed by the lookup table preparing unit 8 is shown in Fig. 5, which is a detailed diagram 
of the operation performed at step S12 in Fig. 2. 

[0033] At step S21 , a one-dimensional lookup table for individual RGB color components is prepared based on the 
input device profile and the output target film profile that are selected by the input/output device selecting unit 7. In this 
embodiment, a lookup table shown in Fig. 6 is prepared with which input device profile data corresponding to the same 
40 patch are converted into data for the output target film profile. The individual points at which data are not stored in the 
profile are linearly interpolated with each other, and conversion data are prepared. At both ends, points (255, 255) and 
(0, 0) are linearly interpolated. Although linear interpolation is employed for this embodiment, non-linear interpolation 
using a spline curve or a Bezier curve may be employed. 

[0034] At step S22, the obtained lookup table is stored in the lookup table holding unit 9. 
45 [0035] Fig. 7 is a flowchart showing the processing performed by the image correcting unit 10. This is a detailed 
diagram of the operation performed at step S13 in Fig. 2. 

[0036] At step S31 , image data for one pixel are read from the image buffer 4 and are corrected by referring to the 
lookup table held in the lookup table holding unit 9, and are then used to overwrite data recorded in the image buffer 4. 
[0037] As is described above, for the image correction process performed in this embodiment, tone reproduction 

so and color reproduction are corrected in accordance with the tone reproduction for the output target film. 

[0038] In this embodiment, a lookup table is prepared for each color component in order to increase the speeds at 
which the lookup table is prepared and for preparing the lookup table and at which image data is corrected. Furthermore, 
data concerning gray scales are stored in a profile in order to quickly prepare the lookup table with which both tone 
reproduction and color reproduction can be preferably corrected. As a result, the gray level that is important for the 

55 reproduction of tones can be preferably reproduced by using the gray scales, and the color balance can be corrected. 
[0039] Fig. 1 1 is a flowchart showing the processing performed by the edge emphasis processing unit 1 2. This is a 
detailed diagram of the operation performed at step S14 in Fig. 2. 

[0040] When at step S1 3 an image is corrected by using the lookup table prepared at step S1 2 in Fig. 2, the colors 
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that are reproduced for an output image can resemble those for the selected film. Generally, however, in a highlighted 
portion the operation performed at step S1 3 tends to sacrifice individual color component tones in order to obtain a 
preferable contrast for these color components in a half-tone portion. Therefore, the edge emphasis processing unit 
is employed to compensate for the lack of tones in the highlighted portion. 
s [0041] First, at step S51 RGB luminance data for one pixel are read from the image buffer 4. 

[0042] At step S52, for each RGB pixel the obtained RGB luminance data are compared with a threshold value. 
When all the RGB luminance data are smaller than the threshold value, or are for pixels at the ends of an image, 
program control moves to step S54. In the other case, program control goes to step S53. 

[0043] At step S53, a 3 x 3 edge emphasis filter is used to filter color component data that are equal to or greater 
10 than the threshold value. Color component data that are smaller than the threshold value are not filtered. 

[0044] At step S54, the obtained RGB luminance data are written in the image buffer 13 for copy. When the edge 

emphasis processing is not performed, the RGB data fetched at step S51 are written unchanged in the image buffer 1 3. 

[0045] At step S55, a check is performed to determine whether all the pixels have been processed. When all the 

pixels have been processed, program control advances to step S56. When all the pixels have not been processed, 
is program control returns to step S51 . 

[0046] At step S56 all the contents of the image buffer 1 3 for copy are copied to the image buffer 4. 

[0047] The threshold value used at step S52 may be the same for all the color components, or may differ for each 

color component. 

[0048] According to the first embodiment, an image obtained by a specific input device can resemble an image 
20 reproduced using a specific film. For example, a lookup table is prepared with which the tone characteristic for an input 
device in Fig. 8 is converted into a tone characteristic for a silver halide film shown in Fig. 9, so that an image obtained 
by a specific device can approximate an image reproduced by using a specific silver halide film. As a result, preferable 
tone reproduction and desired color reproduction can be easily implemented. The desired color reproduction is a very 
effective means for enhancing the quality of an image recorded by an input device, such as a digital camera. 
25 [0049] Since a plurality of output target film profiles are stored, the characteristics of various films can be coped with. 
Thus, the tone reproduction and color reproduction desired by a user can be provided. 

[0050] There are many input device types and also many color shifting methods for obtaining preferable color repro- 
duction. In this embodiment, therefore, an input device profile and an output target film profile are separately stored in 
order to cope with various combinations of an input device and an output target film. Further, when the number of input 
30 device types and the number of output target files are increased, only the profiles of corresponding devices or films 
need be added. 

[0051] Since an image obtained by an input device is so corrected that tones and colors of the image are similar to 
those produced by using a silver halide film, and since edge emphasis processing is performed to obtain preferable 
tones in a highlighted portion, an image having a high quality can be output. 

35 

(Second Embodiment) 

[0052] For image correction in a second embodiment, in addition to the processing explained for the first embodiment, 
a lookup table is prepared based on a histogram for an input image. 
40 [0053] The second embodiment will now be described while referring to the accompanying drawings. No detailed 
explanation will be given for arrangements and processing that correspond to those in the first embodiment. 
[0054] Fig. 12 is a diagram illustrating the arrangement of the essential portion of an image correction apparatus 
according to the second embodiment of the present invention. 

[0055] The image correction apparatus in Fig. 12 comprises: an image inputting unit 2, an image outputting unit 3, 
45 an image buffer 4, an input device profile holding unit 5, an output target film profile holding unit 6, an input/output 
device selecting unit 7, a lookup table preparing unit 8, a lookup table holding unit 9, an image correction unit 10, an 
edge emphasis processing unit 12, an image buffer 1 3 for copy, a histogram preparing unit 1 4, and a histogram holding 
unit 15. 

[0056] The image inputting unit 2 fetches data from an input image 1 and writes them in the image buffer 4, and the 
50 image outputting unit 3 writes to an output image 11 data written in the image buffer 4, which is used to store image 
data. The input device profile holding unit 5 holds profiles for several input device types and for an input device that is 
currently selected. The output target film profile holding unit 6 stores profiles for several output film types and for an 
output film that is currently selected. The input/output device selecting unit 7 selects an input device and stores its 
name in the input device profile holding unit 6, and also selects an output target film and stores its name in the output 
ss target film profile holding unit 6. Based on a histogram stored in the histogram holding unit 1 5, the lookup table preparing 
unit 8 calculates parameters required for correction, and prepares a lookup table and stores it in the lookup table 
holding unit 9. Also, based on data stored in the input device profile holding unit 5 and the output target film profile 
holding unit 6, the lookup table preparing unit 8 prepares a lookup table and stores it in the lookup table holding unit 
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9, which is used to store lookup tables. The image correcting unit 10 synthesizes the two types of tables stored in the 
lookup table holding unit 9 and corrects an image stored in the image buffer 4. The edge emphasis processing unit 12 
emphasizes the edges of a highlighted portion. The image buffer 1 3 for copy is used to temporarily copy the contents 
of the image buffer 4 to perform edge emphasis processing. The histogram preparing unit 14 prepares a histogram 
s based on image data stored in the image buffer 4 and stores the histogram in the histogram holding unit 15. The 
histogram holding unit 15 is used to store the histogram for all the image data. 

[0057] The image correction apparatus can be implemented by supplying to a personal computer, for example, a 
program for performing, or for exercising control of the operations of the individual sections in Fig. 12. In this case, the 
CPU of the personal computer performs, or exercises control of the individual section operations based on the contents 
10 of the supplied program. 

[0058] The processing performed for the second embodiment will now be described in detail by employing a specific 
example. 

<lmage processing in the second embodiment 

15 

[0059] Fig. 1 3 is a flowchart showing the processing for the second embodiment. 

[0060] At step S201, an input image 1 is fetched from the image inputting unit 2, and the image data are stored in 
the image buffer 4. 

[0061] At step S202, the histogram preparing unit 14 prepares a histogram based on the image data stored in the 
20 image buffer 4, and stores the histogram in the histogram holding unit 15. The detailed operation of the histogram 
preparing unit 14 will be described later while referring to Fig. 14. 

[0062] At step S203, the lookup table preparing unit 8 prepares a lookup table. The detailed operation of the lookup 
table preparing unit 8 will be described later while referring to Fig. 16. 

[0063] At step S204, the image correcting unit 1 0 corrects an image. The detailed operation of the image correcting 
25 unit 10 will be described later while referring to Fig. 18. 

[0064] At step S205, the edge emphasis processing unit 12 emphasizes the edges of the highlighted portion in the 
same manner as described in the first embodiment. 

[0065] At step S206, the contents of the image buffer 4 are written to the output image buffer 11 by the image out- 
putting unit 3. 

30 

' < Histogram preparing process> 

[0066] The operation performed by the histogram preparing unit 14 is shown in Fig. 14, which is a detailed flowchart 
of step S220 in Fig. 13. 

35 [0067] At step S211, image data for one pixel are extracted from the image buffer 4. The luminance (R, G, B) for 
each of the RGB color components is stored as image data. 

[0068] At step S21 2 the RGB image data values are employed to calculate luminance L for a relevant pixel by using 
the following equation. 

40 

L = (3*R + 6*G + rB)/10 

[0069] At step S213, the histogram stored in the histogram holding unit 15 is updated. The histogram holding unit 
15 holds histogram HistL for the obtained luminance L, and HistR, HistG and HistB in which the cumulative luminance 
45 values of the RGB colors are stored in accordance with the luminance L of the relevant pixel. The histograms are all 
set to 0 in the initial state. 

[0070] Updating of the histogram is performed as folbws. 
50 HistR[L] = HistR[L] + R 



HistG [L] = HistG[L] + G 

55 

HistB[L] = HistB[L] + B 
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HistLfL] = HistLJL] = I 



[0071] At step S214, a check is performed to determine whether all the pixels have been processed. When all the 
s pixels have been processed, the processing is thereafter terminated. When not all the pixels have been processed, 
program control returns to step S21 1 . 

[0072] The histogram HistLthat is prepared is shown in Fig. 15. 
<Lookup table preparation process> 

10 

[0073] ■ The operation performed by the lookup table preparing unit 8 is shown in Fig. 16, which is a detailed flowchart 
for step S203 in Fig. 13. 

[0074]. At step S221, the maximum luminance of an image is obtained from the histogram stored in the histogram 
holding unit 15. Thus, for the histogram in Fig. 15 the maximum luminance is 252. 

is [0075] At step S222, the luminance LH\ obtained by subtracting from 255 a predetermined value (10 in Fig. 15), is 
compared with the maximum luminance. That is, in this example, the values 255, 245, 235, ... are obtained by sub- 
traction, and each resultant value is compared with the maximum luminance value. In Fig. 15, LH' = 245. When the 
maximum luminance value is greater than the luminance LH*, an area including pixels at a predetermined ratio (in Fig. 
15, 1% of the total pixels) is obtained. The minimum luminance in that area is defined as a highlighted point LH (LH = 

20 234 in Fig. 15). The average luminance (RH, GH, BH) of RGB in an area wherein the luminance is equal to or higher 
than LH and equal to or lower than LH' is calculated by using the following equations. 



2s RH = £ HistR lm) / Y, KistL [m] 



bt=LH m-LH 



30 



35 



GH = £ HistG[m) I £ HistL[m) 



ih' lb! 
40 BH = £ HxstB[m] I £ HistLlm] 



ttt*LH JB=LH 



[0076] At step S223, the minimum luminance level of an image is obtained from the histogram HistL stored in the 
45 histogram holding unit 4. The minimum luminance is 5, according to the histogram in Fig. 15. 

[0077] At step S224, a predetermined value (10 in Fig. 15) is added to the luminance level, beginning with 0, and 
the resultant value LS' is compared with the minimum luminance level obtained at step S223. When the minimum 
luminance is smaller than the luminance LS' (10 in Fig. 15), an area including pixels at a predetermined ratio (in Fig. 
15, 1% of the total pixels) is acquired. The maximum luminance in that area is defined as a shadow point LS (LS = 22 
so in Fig. 15). The average luminance (RS, GS, BS) of RGB in an area wherein the luminance is equal to or higher than 
LS' and equal to or lower than LS is calculated by using the following equations. 

LS LS 

55 RS « £ HistRlm] I J) HistLlm] 

n^LS* m-is* 
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LS LS 

GS = £ HistG[m\/Y, HistLlm] 

5 m^LS* arLS* 



10 

LS LS 

T5 

[0078] At step S225, lcx>kup tables LUTR, LUTG and LUTB for individual RGB values are prepared by using the 
obtained RH, GH, BH, RS, GS and BS. The thus prepared lookup tables, for which a detailed explanation will be given 
later, are shown in Fig. 17 A. These tables are stored in the lookup table holding unit 9. 

[0079] At step S226, based on the profiles selected for the input device and the output target film by the inputoutput 
20 device selecting unit 7, one-dimensional lookup tables LUTRDD, LUTGDD and LUTBDD are prepared for individual 
RGB color components in the same manner as in the first embodiment. The thus prepared lookup tables, for which an 
explanation will be given later, are shown in Fig. 17B. 

[0080] At step S227, the obtained lookup tables are stored in the lookup table holding unit 9. 
[0081] The lookup tables LUTR, LUTG and LUTB, shown in Fig. 17 A, are used to correct the color contrast and for 
25 the assimilation of color. In this embodiment, gamma for highlighting is set in the descending order G, B and R. Since 
G and B are exaggerated relative to R, the assimilation of color (color fog) of an image that appears bluish can be 
corrected. At the same time, the color contrast can be corrected. 

[0082] The lookup table in Fig. 17B is the table with which data from the input device profile corresponding to the 
same patch are converted into data for the output target film profile. The points for which no data are stored in the 
30 profile are linearly interpolated and conversion data are prepared. At both ends, points (255, 255) and (0, 0) are linearly 
interpolated. While linear interpolation is employed in this embodiment, non-linear interpolation using a spline curve 
or a Bezier curve, for example, may be employed. 

<lmage correction process> 

35 

[0083] The processing performed by the image correcting unit 10 is shown in Fig. 18, which is a detailed flowchart 
for step S204 in Fig. 13. 

[0084] At step S231 new lookup tables are prepared by synthesizing the two types of lookup tables stored in the 
lookup table holding unit 9 using the following equations. 

40 

LUTTmpR[i] = LUTRDD[LUTR[i]] 



LUTTmpG[i] = LUTGDD[LUTG[i]] 



LUTTmpB[i] = LUTBDD[LUTB[i]] 

so In these equations, i is a value that is equal to or greater than 0, and is equal to or smaller than the maximum luminance 
value. 

[0085] At step S232, image data for one pixel is extracted from the image buffer 4. Individual RGB luminance values 
(R, G, B) are stored as image data. 

[0086] At step S233, the image data extracted from the image buffer 4 are corrected based on the obtained lookup 
55 tables LUTRTmp, LUTGTmp and LUTBTmp, and the resultant image data are used to overwrite the original location. 

R = LUTTmpRfR] 
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G = LUTTmpG[G] 



5 B = LUTTmpB[B] 

[0087] At step S234, a check is performed to determine whether image data for all the pixels have been corrected. 
When the correction process has been completed for all the pixels, the processing is thereafter terminated. When the 
correction process has not been completed for all the pixels, program control returns to step S232. 
10 [0088] As is described above, in the image processing for this embodiment, optimal correction provided for white 
balance and for color contrast is performed for each image, and tone reproduction and color reproduction are corrected 
in accordance with the tone reproduction characteristics of the output target film. 

[0089] In this embodiment, a lookup table is prepared for each color component in order to increase the speeds for 
the preparation of a lookup table and for image correction. In addition, data concerning a gray scale is stored in a 
is profile, so that a lookup table can be quickly prepared with which both tone reproduction and color reproduction can 
be preferably corrected. By employing the gray scale, the gray level that is important for tone reproduction can be 
preferably reproduced, and color balance can be corrected. 

[0090] In this embodiment, digital values of 0 to 255 are employed to describe luminance data; however, the maximum 
data value is not limited to 255, and instead of the luminance value, printing dot density may be employed. 
20 [0091] Further, at step S212 the luminance value is calculated by weighting the luminance value at a ratio of R:G:B 
= 3:6:1 ; however, other weighting may be employed for the calculation, or the average of a maximum RGB value and 
a minimum RGB value may be employed. 

(Third Embodiment) 

25 

[0092] In a third embodiment, an image correction process is changed in accordance with whether an input device 
is a digital camera. 

[0093] Since correction for color assimilation and contrast based on the histogram explained in the second embod- 
iment is a process employing the distribution of colors for an input image, regardless of the input device, preferable 

30 results can be obtained. However, since the digital development correction as explained in the first and the second 
embodiments is a process for adjusting the tone characteristics of an output image to conform to the tone characteristics 
of an arbitrary film, the quality of an output image may be deteriorated if the input image has the tone characteristics 
of the relevant film. In other words, digital development may not be good for a silver halide image that is read by a 
scanner, or an image that is read by a film scanner. 

3S [0094] Therefore, in this embodiment, when an input device is a digital camera, the same process as in the second 
embodiment is performed, and when the input device is not a digital camera, only the correction of color assimilation 
and contrast is performed; digital development correction is not performed. 

[0095] No detailed explanation will be given for arrangements and processing that correspond to those in the first 
and the second embodiments. 

40 [0096] Fig. 1 9 is a diagram showing the arrangement of the essential portion of an image correction apparatus ac- 
cording to the third embodiment. 

[0097] The image correction apparatus in Fig. 19 comprises: an image inputting unit 2, an image outputting unit 3, 
an image buffer 4, an input device profile holding unit 5, an output target film profile holding unit 6, an output device 
selecting unit 7, a lookup table preparing unit 8, a lookup table holding unit 9, an image correcting unit 10, an edge 
45 emphasis processing unit 1 2, an image buffer 1 3 for copy, a histogram preparing unit 14, a histogram holding unit 1 5, 
and an image judging unit 16. 

[0098] The image inputting unit 2 fetches data from an input image 1, and writes them in the image buffer 4. The 
image outputting unit 3 writes data stored in the image buffer 4 to an output image 11 . The image buffer 4 is used to 
store image data. The input device profile holding unit 5 holds profiles for several input device types and for an input 

50 device that is currently selected. The output target film profile holding unit 6 stores profiles for several output film types 
and for an output film that is currently selected. The output device selecting unit 7 also selects an output target film 
and stores its name in the output target film profile holding unit 6. Based on a histogram stored in the histogram holding 
unit 15, the lookup table preparing unit 8 calculates parameters required for correction, and prepares a lookup table 
and stores it in the lookup table holding unit 9. Also, when an input device is a digital camera, based on data stored in 

55 the input device profile holding unit 5 and the output target film profile holding unit 6, the lookup table preparing unit 8 
prepares a lookup table and stores it in the lookup table holding unit 9, which is used for the storage of lookup tables. 
The image correcting unit 10 corrects an image stored in the image buffer 4 based on the lookup table stored in the 
lookup table holding unit 9. The edge emphasis processing unit 1 2 emphasizes the edges of a highlighted portion. The 
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image buffer 13 for copy is used to temporarily hold a copy of the contents of the image buffer 4 when edge emphasis 
processing is performed. The histogram preparing unit 14 prepares a histogram based on image data stored in the 
image buffer 4, and stores the histogram in the histogram holding unit 15. The histogram holding unit 15 is used to 
store the histogram for all the image data. The image judging unit 1 6 determines what type of image is being processed. 
[0099] An image correction apparatus can be implemented by supplying to a personal computer, for example, a 
program for performing, or for exercising control of the operations of the individual sections in Fig. 1 9. In this case, the 
CPU of the personal computer performs, or exercises control of the individual section operations based on the contents 
of the supplied program. 

[0100] The third embodiment will now be described in detail by employing a specific example. 
[0101] Fig. 20 is a flowchart showing the processing performed for the third embodiment. 

[0102] At step S301 , image data for an input image 1 and an image header are read by the image inputting unit 2, 
and are stored in the image buffer 4. 

[0103] At step S302, the image judging unit 16 determines the image type. Specifically, the image judging unit 16 
employs an ID entered in the image header to determine whether the input device used for the image was a digital 
camera or another device. 

[01 04] Fig. 21 is a diagram showing the contents of the image data and the image header stored in the image buffer 4. 
[0105] The ID of the input device is included with the image data, which represent the RGB values of individual pixels, 
and the image judging unit 16 examines the ID to determine the type of input device, which may be, for example, a 
digital camera, a file scanner, or a flat bed scanner. An input device profile is automatically selected in accordance with 
the input device ID stored in the image header. 

[0106] When, at step S302, it is ascertained that the input device is a digital camera, program control moves to step 

S303. When the input device is a device other than a digital camera, program control goes to step S308. 

[0107] At step S303, the histogram preparing unit 14 prepares a histogram based on the image data stored in the 

image buffer 4 and stores it in the histogram holding unit 15. 

[0108] At step S304, the lookup table preparing unit 8 prepares a lookup table. 

[0109] At step S305, the image correcting unit 10 corrects an image. 

[0110] At step S306, the edge emphasis processing unit 12 emphasizes the edges of a highlighted portion. 
[0111] The processes at steps S303 to S306 are the same as those at steps S202 to S205 in Fig. 13 that were 
explained in the second embodiment. 

[0112] At step S307, the data in the image buffer 4 are written by the image outputting unit 3 to an output image 11. 
[0113] At step S308, the histogram preparing unit 14 prepares a histogram based on the image data stored in the 
image buffer 4 and stores it in the histogram holding unit 1 5. This process is the same as the one performed at step S303. 
[0114] At step S309, the lookup table preparing unit 8 prepares a lookup table. 

[0115] The operation of the lookup table preparing unit 8 when the input device is a digital camera is shown in Fig. 
22. The processes at steps S351 to S355 are the same as those at steps S221 to S225 in Fig. 16 that were explained 
in the second embodiment. 

[011 6] At step S31 0, the image correcting unit 1 0 corrects an image. This process is the same as the one performed 
at step S305. 

< Process for changing a selected profile> 

[0117] The operation of the output device selecting unit 7 is shown in Fig. 23. 

[0118] At step S361 , the name of an output film is selected and is stored in the output target film profile holding unit 
6. The name of an output device is selected as the name of an output film in accordance with an instruction that is 
entered by a user at a user interface that is unique to the image correction apparatus of the present invention. 
[0119] The selection of the output film name can be performed any time except during the correction process. 
[0120] In this embodiment, the input device is automatically selected in accordance with the ID of the input device 
that is stored in the image header of the image data. However, a user may manually select the input device. 

(Other Embodiments) 

[0121] In addition, the scope of the present invention may also include an embodiment wherein software program 
code for accomplishing the functions of the embodiments is loaded into a computer (a CPU or an MPU) in an apparatus, 
or in a system, that is connected to various devices in order to operate them, so that the devices are operated by the 
computer in the system, or in the apparatus, in accordance with the stored program. 

[0122] In this case, the program code implements the innovative functions provided by the present invention, and 
the means for supplying the program code to the computer, e.g., the memory medium on which the program code is 
stored, accomplishes the present invention. 
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[0123] A memory medium on which the program code is recorded is, for example, a floppy disk, a hard disk, an 

optical disk, a magneto optical disk, a CD-ROM, a magnetic tape, a nonvolatile memory card, or a ROM. 

[01 24] Another embodiment of the present invention consists of an application wherein, to accomplish the functions 

of the above embodiments, not only does a computer execute program code that is supplied, but in addition, the 

program code interacts either with an OS (Operating System) that is running on the computer or with another software 

program. 

[0125] Furthermore, to accomplish the functions included in the above embodiment, the present invention also pro- 
vides for program code to be stored in memory mounted on a function expansion board in a computer, or in memory 
mounted in a function expansion unit connected to the computer, and for, in consonance with instructions included in 
the program code, a CPU mounted on the function extension board or mounted in the function extension unit to perform 
a part or all of the processing. 

[0126] Although the present invention has been described in its preferred form with a certain degree of particularity, 
many apparently widely different embodiments can be devised without departing from the spirit and the scope of the 
invention. It is therefore to be understood that the invention is not limited to specific embodiments described herein, 
except as defined in the appended claims. 



Claims 

1. An image processing method comprising the steps of: 

holding a profile for an input device and a profile for an output target film; 

preparing a table to approximate a color reproducibility of output target film as to a color reproducibility of the 
input image data on the basis of the profile for the input device and the profile for the output target film; and 
correcting a color of the input image data by using the prepared table. 

2. An image processing method according to claim 1 , wherein data corresponding to a gray chart is described in the 
profile for the input device and the profile for the output target film. 

3. An image processing method according to claim 1 , further comprising the step of: 

selecting the profile for the input device on the basis of information added to an input image. 

4. An image processing method according to claim 1 , wherein the table is prepared for each of color components of 
the input image data. 

5. An image processing method comprising the steps of: 

correcting a color of input image data by using a table prepared on the basis of a color reproducibility for the 
input image data and a color reproducibility for an output target film; and 
emphasizing an edge in a highlighted portion of the color-corrected image data. 

6. An image processing method according to claim 1 , further comprising the steps of: 

performing a white balance correction using a look up table prepared on the basis of a highlighted point and 
a shadow point of the input image data; and 

performing the color correction for the image data obtained by the white balance correction. 

7. An image processing method according to claim 1 , further comprising the steps of: 

judging a type of an input device type according to an input image; and 

determining, in accordance with a result obtained in said judging step, whether the color correction is to be 
performed. 

8. An image processing method according to claim 7, wherein the type of the input device is described as an ID, 
within header information for the input image. 

9. An image processing method according to claim 7, wherein the type of the input device is name of a digital camera, 
a film scanner or a flat bed scanner. 



11 



EP 0 961 487 A2 



10. An image processing method according to claim 9, wherein the color correction is performed when the type of the 
input device is a digital camera. 

11. An image processing method according to claim 10, where, when said input device type is a digital camera, the 
5 profile for the input device is automatically selected in accordance with the name of the device. 

12. An image processing apparatus comprising: 

holding means for holding a profile for an input device and a profile for an output target film; 
10 preparation means for preparing a table to approximate a color reproducibility of an output target film as to a 

color reproducibility of input image data on the basis of the profile for the input device and the profile for the 
output target film; and 

color correction means for correcting the color of the input image data by using the prepared table. 
*5 13. A recording medium on which an image processing program is stored, said program comprising the steps of: 
reading out a profile for an input device and a profile for an output target film; 

preparation means for preparing a table to approximate a color reproducibility of an output target film as to a 
color reproducibility of input image data on the basis of the profile for the input device and the profile for the 
20 output target film; and 

correcting the color of the input image data by using the prepared table. 

14. Apparatus according to claim 12 and including means for preparing a histogram based on the input image data, 
means for storing the histogram, and means for utilising the stored histogram to correct the colour of the input 

2S image data. 

15. A method according to claim 1 , and including preparing and storing a histogram derived from the input image data 
and utilising the stored histogram to correct the colour of the input image data. 

30 
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FIG. 5 
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FIG. 13 
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FIG. 17 A 
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